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In this letter we present a dynamical study of the structure of metastable states (corresponding 
to TAP solutions) in a mean-field spin-glass model. After reviewing known results of the statical 
approach, we use dynamics: starting from an initial condition thermalized at a temperature be- 
tween the statical and the dynamical transition temperatures, we are able to study the relaxational 
dynamics within metastable states and we show that they are characterized by a true breaking of 
ergodicity and exponential relaxation. 
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The recent developments in the theory of spin glass dynamics have made clearer the similarity of behaviour in 
spin glasses and in glasses HH . In this context it seems at the moment that a certain category of spin glasses, those 
which are described by a so called one step replica symmetry breaking (RSB) transition Q] , are good candidate models 
for a mean field description of the glass phase ■ ^ n these systems the presence of metastable states generates a 
purely dynamical transition (which is supposed to be rounded in finite dimensional systems (^,^1) at a temperature 
^ ■ Td higher than the one obtained within a theory of static equilibrium, T s . 

OS ' The spherical p-spin spin glass introduced in [0J|] is an interesting example of this category. It is a simple enough 
system in which the metastable states can be defined and studied by the TAP method ||. In this paper we want 
to provide a better understanding of these metastable states, using a dynamical point of view. We shall show the 
existence of a true ergodicity breaking such that these metastable states, in spite of being excited states with a finite 

jy-j ■ excitation free energy per spin, are actually dynamically stable even at temperatures above Td- 

\ The spherical p-spin spin glass describes N real spins Sj, i £ {1, TV} which interact through the Hamiltonian: 

H{a) = - Jii,-,i P s h ■ ■ ■ s ip (1) 

Q ■ l<ii<---<jp<7V 

together with the spherical constraint on the spins: Y)^L^ sf = N. The couplings are gaussian, with zero mean and 
variance p\/{2N p ~ 1 ). In the p > 2 case it shows an interesting spin glass behaviour, simple enough to allow for 
. detailed analytical treatment. 

In the static approach, one describes the properties of the Boltzmann probability distribution of this system. The 
replica method shows the existence of a static transition with a one step RSB at temperature T s 0. This transition 
reflects the fact that, below T s , the Boltzmann measure is dominated by a few number of pure states, a scenario which 
is well known from the random energy model ]Tc[ |. 

Staying within a static framework, the TAP approach pd|Jl^ | provides some more insight into the physical nature 
of this system. The TAP equations can be derived through a variational principle on the local magnetizations 
m% =< Si >, from a free energy / {{mi}) which is best written in terms of radial and angular variables, q and (with 
m i = \/qSi)-> m the form |TT| : 

/ {{mi}) = q p / 2 E° {{s t }) - | ln(l -q)-±[{p- l)qP - pq^ + 1] ; (2) 
where the angular energy is: 

E°{{ Si }) = - Yl Jh,-,iJh---K ■ (3) 

l<ii<— <i„<N 
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At zero temperature the TAP states are just unit vectors which minimize the angular energy E° . There actually exist 
such states for E° S [E min ,E c = — y/2(p — Denoting by sf one zero temperature state, of energy E°, it gives 

rise at finite temperature T to one TAP state a given by: 



mf = y/q{E°,T)§f , (4) 
where q(E, T) is the largest solution of the equation: 



(5) 



The free energy of this state, f a , at temperature T, is obtained by inserting in the TAP free energy (g) the corre- 
sponding values of the angular energy, E° = E^ and of the self overlap, q = q a = q[E^T\. The corresponding 
energy is: 

Ea = q p J 2 E° a - ±[(p - l)ql - rf 1 + 1] . (6) 

When changing the temperature, one can follow the metastable states which keep the same angular direction; their 
order in free energy or energy, at fixed T, is the same as their order in E°. When raising T, a state disappears at a 
temperature T max (E°) (where equation (|^) ceases to have solutions). T max (E°) is a decreasing function of E°; the 
most excited states, with E = E c , disappear first at T max (E c ), and the lowest at T max (E m i n ) = Ttap- Above Ttap, 
the only remaining state is the paramagnetic one with q = and free energy F para = — 1/ (4T) . 

To complete the description of metastable states at any temperature, one only needs the density of states p(E°) 
with an angular energy E°. This has been computed in the multiplicity is exponentially large, giving a finite 
complexity density s®(E°), defined as: 

The complexity at finite temperature is easily deduced from this s°. We shall denote by S c (f,T) the logarithm 
of the number of TAP states at free energy / and temperature T. The Boltzmann partition function can then be 
approximated as the sum over all TAP solutions: 

/ (f-TS c (f,T)) \ 
dfexp I I (8) 

which can be evaluated at large N by a saddle point method. At temperatures T > T^, with = 
y/p{p — 2)P~ 2 (p — 1) 1_ p/2, the Boltzmann measure is dominated by the paramagnetic state q = 0. At any Te [T s , TJ, 
the Boltzmann measure is dominated by a class of TAP solutions, those of free energy / = f eq (T). Because of their 
extensive complexity, this gives for the total equilibrium free energy: 

f tot = -Tln(Z) - f eq (T)-TS c (f eq (T),T) . (9) 

The computation of f eq is easily done One finds that f to t is equal to the paramagnetic free energy in this range. 

Below T s the lowest lying TAP states dominate the Boltzmann measure, leading to RSB. The situation is summarized 
in figure 1. Compared to usual phase transition, the situation is complicated by the existence of a finite complexity. 
Actually we see that between the two transition temperatures T s and Td, the situation is unclear: the total equilibrium 
free energy seems to get two equal contributions, from the paramagnetic state and from a bunch of TAP solutions 
with non-zero q. One can wonder if there is a phase coexistence, or simply a problem of double counting in the TAP 
approach. This issue, which is an important one if one aims at understanding the finite dimensional behaviour of this 
type of systems ||, can in fact be clarified within a dynamical approach as we now show. Let us also mention that 
some purely static approaches also carry relevant information on related issues pyJlq] • 
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Free energy 




tap 



Free energy versus temperature; (1): free energy of the paramagnetic solution for T > T^, ftot for T < (2): free energy of the lowest 
TAP states, with zero temperature energy E m i„; (3): free energy of the highest TAP states, corresponding to E c \ (4): an intermediate 
value of Eq leads to an intermediate value of / at any temperature; (5): feq{T); the difference between curves (5) and (1) gives the 

complexity TS C (feq(T), T). 

The TAP structure of states has never been explored dynamically: indeed, the usually studied out of equilibrium 
dynamics of the spherical p-spin model starts from a random configuration, and never goes below the threshold 
corresponding to the upper TAP solutions. This process has been studied in EJ|: an interesting aging behaviour has 
been found at temperatures T <Td, but the energy density of the system only goes asymptotically to the one of the 
highest TAP states (the threshold states with angular energy E° = E c ). Hence, it is impossible to explore TAP states 
via this kind of dynamics. 

Here we will use a different approach for the dynamics Eg, where we start from a spin configuration which is 
picked up from a Boltzmann distribution at temperature T , and then let the system relax at temperature T. We 
shall concentrate on the case where T' S [T a , TJ, which means that our initial configuration will belong to the TAP 
states with free energy f eq (T'). This will lead to the study of the relaxation inside one TAP state. 

The relaxational dynamics at temperature T is given by the Langevin equation: 



dsAt) dH . . . . , . 
= —^--»(t)s i (t)+r h (t) 



(10) 



where H is the Hamiltonian (fij), fj, is the Lagrange multiplier implementing the spherical constraint, and rji is a 
gaussian white noise with zero mean and variance IT. The dynamics is described by the behaviour of two-times 
correlation and reponse functions defined by: 



C(t,t') 



N 



-^2<8i{t)8i(t')>, r(t,f) 

i=l 



1 ^ d< Si(t) > 
dhi(t') ' 



(11) 



where < . > is a mean over the thermal noise, and an overline denotes a mean over the coupling constants. 

Using the usual field theoretical techniques for out of equilibrium dynamics [i6fl , in the large N limit, it is possible to 
study the dynamics at temperature T, starting from a Boltzmann measure at temperature T'. In order to implement 
this initial -sample dependent- measure, it is necessary to introduce replicas \17 1£| and to write dynamical equations 
for two-times overlaps between replicas C ab (t,t') — < s a (t)s b (t') >, a and b being replica indices. The obtained 
equations differ from the usual out of equilibrium ones (corresponding to T' = oo ][L5| ) by terms involving a coupling 
to the initial configuration, i.e. C ab (t,0). Besides, as noted in EJ|, the time evolution respects the initial replica 
symmetric or RSB structure of the C ab , i.e. the static replica structure describing equilibrium at T'. 

For the p-spin model with T" > T s the initial condition is replica symmetric, with C ab (0,0) = 6 a b. Therefore, at 
all times we can write C ab (t,t') = C(t,t , )8 a b- The obtained equations for the correlation and response functions read 
p|, for any T > T s , and t > t': 



n{t) = I da 
Jo 



^ C P-i(t jS )„____i)^- 2 (t, S ) 



r(t,s)+T 



^Lcr-^o) (i-c(t,o)) 
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dr{t,f) 

at 



dC(t, t') 
dt 



-H(t)r(t, t') - Vb-H J* ds CP- 2 (t, s)r(t, s)(r(t, f) - r(s, t')) 
JLc^&O) r(t,f) 

-H(t)C(t,1?) + Zj ds C^CMMO) 



pjp ~ !) 
2 j, 
P rtp-l 



ds C p - 2 (t,s)r(t,s)(C(t,t') - C{s,t')) 



^cp-\t, o) c(t, f) + ^c-\t, 0) C(f , 0) 



(12) 



Let us examine the situation first for T = T': since we start at equilibrium, we expect equilibrium dynamics 
satisfying both time translation invariance (TTI) and the fluctuation dissipation theorem (FDT): C(t,t') — C eq (t — 
t'), r(t,t') = r eq (t — t') with r eq (r) = — ~ d ^ q . The equations (^2[), with this Ansatz, reduce to a single equation for 
the evolution of C eg (r): 



dC eq (r) 
dr 



= -MooCe g (r) - ^ J du C* 



(t-u) 



dC eq (r) 
Or 



(13) 



where fi^ — T, and C eq (0) — 1. Above T^, this equation describes the relaxation within the paramagnetic state, 



0. Below Td, the condition of dynamical stability dc "i( T ) < q leads to a non zero limit C 



with lirn^oo C eq (T) 

C e g(r) [||; this limit is given by the largest solution of: 



for 



P 
2T 2 



C£7 2 (l-C 00 ) = l 



(14) 



(the other non zero solution is unstable with respect to the dynamics Q13J) ) . This value is precisely the self overlap q 
of the TAP states reflecting the statics at T, i.e. with free energy f eq (T). This means that, for temperatures between 
the statical and the dynamical transition temperatures, the thermalized system is trapped inside a TAP state, and 
not in a paramagnetic state, for which would be zero (as for T > Tj). We can also exclude the possibility of a 
coexistence, which would lead to some intermediate value: the paramagnetic state has disappeared at Td, and the 
Gibbs state is formed by the bunch of TAP solutions having the suitable free energy f eq (T), and a finite complexity 
density. 

To get further insight, always starting from a thermalized configuration at temperature T' £ [T s ,Td], we now 
study the dynamics at a temperature T different from T' . In our study of the dynamical equations (|l^), we have 
found numerically (using the type of algorithm developped in |l!|) that the system reaches after a short transient 
a stationnary regime where TTI and FDT hold (see figure 2). We have then shown analytically the consistency of 
such a solution. The possibility of such a situation has already been conjectured in Jl8| , together with an interesting 
connection to the static approaches developped in [p^|,p^l . 




p=3 model, with T a z 
and C(t, t') versus t 



.586, T d «s .612; numerical integration of equations ( p^ ) for T" = .605, T = .6; we plot C(t, 0) versus t (solid line), 
t' for tl = 6, 12, 18, 24 (symbols); the dotted curve is the numerical integration of (^5j), and the dotted line is the 

value of Coo obtained by (|lrj). 
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In order to study this solution analytically, we introduce as previously C eq (r), r eq (r), Cx> = lfm r ^oo C e(? (T), and 
I = linii— ,00 C(t, 0), and obtain the equation: 



dC eq (r) 



f [ du C*-\u) r eq (r - u) - JLc*, + ^F. 



(15) 



Besides, /loo, Coo and I satisfy the following set of equations, obtained by taking tf = 0, t — ► 00 in (|l2|), and r — ► 00 
in (ITBl): 



moo - r + ^c^-^i - Coo) - - 

p-2 = 2TT' 



P(l - Coo) 



rCoo = ^ 7 P(l-Coo) + ^CS D - 1 (l-C oc ) 2 (16) 

and the energy reached dynamically at large times is: i?oo = (C^ — 1) — ^7- 

It is then straightforward to check that the overlap Coo and the energy _Eqo are identical to the values characteristic 
of certain TAP states at the temperature T. These states are precisely those obtained by following the equilibrium 
TAP states at temperature T' (which pick up a certain value Ej>i of the angular energy) to temperature T, by keeping 
the same direction in s space, but changing the overlap from q(Ej,,, T') to q(E^,, T). 

From (|l5|), it is possible to show that the relaxation of C eq (T) is of the form T~ 3 / 2 exp(— t/tq). The relaxation 
time To can also be computed, and has a quite complicated expression that we do not reproduce here. It diverges for 
the highest TAP states (corresponding to E° = E c ). Of course, this exponential relaxation can only happen as long 
as the followed TAP solution still exists at temperature T: if T becomes larger than T max (Ej,,), we observe a fast 
relaxation to the paramagnetic state, with Coo =1 = 0. 

We have thus shown that the TAP solutions are real states, corresponding to a full breaking of ergodicity: starting 
within a TAP state (which can be achieved by our trick of using thermalized initial conditions at a temperature 
T"), one relaxes within this state with a finite relaxation rate, and one can even follow this state when changing 
the temperature. Besides, the Gibbs measure below the dynamical transition is made of a superposition of TAP 
states, which are different ergodic components, totally separated from each other in the dynamical evolution. The 
paramagnetic solution, valid above X^, disappears at T ( i- Note that the way in which this occurs is not clear, and 
we leave this open question, which is crucial for a better understanding of aging dynamics, for future work. Some 
TAP states exist as independent ergodic components even at temperatures T € [Tci,Ttap]- They are not seen in 
the usual dynamics because they are difficult to find: starting from random initial conditions one stays in the big 
paramagnetic ergodic component. If one succeeds in starting within a TAP state, one stays within this state even by 
rising the temperature above Td (but below the T max of this state). One should notice that the usual dynamics at 
a temperature below T^, starting from a random configuration, only leads to a "weak ergodicity breaking" |po| , |l5| , 
where the self overlap vanishes at very large time differences (much larger than the waiting time). This is explained 
|^5| , pl| by the fact that the system, which was initially in the (infinite temperature) paramagnetic state, does not 
find any TAP state in a finite time, but stays at energy density O(l) (going to zero as t goes to infinity) above the 
threshold. On the contrary, there is no sign of aging when one starts within a TAP state. This is in agreement with 
some recent intuitive scenarios for aging |2l],^2| . 
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